Projection-based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture

In this paper, we propose a projection-based mixed reality system that visualizes the tangential deformation of a nonrigid surface by superimposing graphics directly onto the surface by projected imagery. The superimposed graphics are deformed according to the surface deformation. To achieve this goal, we develop a computer vision technique that estimates the tangential deformation by measuring the frame-by-frame movement of an infrared (IR) texture on the surface. IR ink, which can be captured by an IR camera under IR light, but is invisible to the human eye, is used to provide the surface texture. Consequently, the texture does not degrade the image quality of the augmented graphics. The proposed technique measures individually the surface motion between two successive frames. Therefore, it does not suffer from occlusions caused by interactions and allows touching, pushing, pulling, and pinching, etc. The moving least squares technique interpolates the measured result to estimate denser surface deformation. The proposed method relies only on the apparent motion measurement; thus, it is not limited to a specific deformation characteristic, but is flexible for multiple deformable materials, such as viscoelastic and elastic materials. Experiments confirm that, with the proposed method, we can visualize the surface deformation of various materials by projected illumination, even when the user’s hand occludes the surface from the camera.Punpongsanon, P., Iwai, D. & Sato, K. Projection-based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture. Virtual Reality 19, 45–56 (2015). https://doi.org/10.1007/s10055-014-0256-y.This is a post-peer-review, pre-copyedit version of an article published in Virtual Reality. The final authenticated version is available online at: https://doi.org/10.1007/s10055-014-0256-y

Programmable filament: Printed filaments for multi-material 3D printing

From full-color objects to functional capacitive artifacts, 3D printing multi-materials became essential to broaden the application areas of digital fabrication. We present Programmable Filament, a novel technique that enables multi-material printing using a commodity FDM 3D printer, requiring no hardware upgrades. Our technique builds upon an existing printing technique in which multiple filament segments are printed and spliced into a single threaded filament. We propose an end-to-end pipeline for 3D printing an object in multi-materials, with an introduction of the design systems for end-users. Optimized for low-cost, single-nozzle FDM 3D printers, the system is built upon our computational analysis and experiments to enhance its validity over various printers and materials to design and produce a programmable filament. Finally, we discuss application examples and speculate the future with its potential, such as custom filament manufacturing on-demand.Haruki Takahashi, Parinya Punpongsanon, and Jeeeun Kim. 2020. Programmable Filament: Printed Filaments for Multi-material 3D Printing. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST '20). Association for Computing Machinery, New York, NY, USA, 1209–1221. DOI:https://doi.org/10.1145/3379337.3415863.UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology [October 20 - 23, 2020

Demonstration of ObserVAR: Visualization System for Observing Virtual Reality Users using Augmented Reality

Santawat Thanyadit, Parinya Punpongsanon, and Ting-Chuen Pong. 2020. Demonstration of ObserVAR: Visualization System for Observing Virtual Reality Users using Augmented Reality. In SIGGRAPH Asia 2020 XR (SA '20). Association for Computing Machinery, New York, NY, USA, Article 13, 1–2. DOI:https://doi.org/10.1145/3415256.3421495.SA '20: SIGGRAPH Asia 2020 [December 4 - 13, 2020

Topology Optimization with Text-Guided Stylization

We propose an approach for the generation of topology-optimized structures with text-guided appearance stylization. This methodology aims to enrich the concurrent design of a structure's physical functionality and aesthetic appearance. Users can effortlessly input descriptive text to govern the style of the structure. Our system employs a hash-encoded neural network as the implicit structure representation backbone, which serves as the foundation for the co-optimization of structural mechanical performance, style, and connectivity, to ensure full-color, high-quality 3D-printable solutions. We substantiate the effectiveness of our system through extensive comparisons, demonstrations, and a 3D printing test

Substituting Teleportation Visualization for Collaborative Virtual Environments

Santawat Thanyadit, Parinya Punpongsanon, Thammathip Piumsomboon, and Ting-Chuen Pong. 2020. Substituting Teleportation Visualization for Collaborative Virtual Environments. Symposium on Spatial User Interaction. Association for Computing Machinery, New York, NY, USA, Article 31, 1–2. DOI:https://doi.org/10.1145/3385959.3422698.SUI '20: Symposium on Spatial User Interaction [October 30 - November 1, 2020

Ground Navigation in 3D Scenes using Simple Body Motions

ICAT－EGVE 2014 (the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments

Adaptive visualization of gas distribution using augmented reality glasses

L. Duan, H. Matsukura, P. Punpongsanon, T. Hiraki, D. Iwai and K. Sato, "Adaptive Visualization of Gas Distribution Using Augmented Reality Glasses," 2020 IEEE 9th Global Conference on Consumer Electronics (GCCE), 2020, pp. 658-659, doi: 10.1109/GCCE50665.2020.9291811

Wearable Sanitizer: Design and Implementation of an Open-source, On-body Sanitizer

Pat Pataranutaporn, Ali Shtarbanov, Glenn Fernandes, Jingwen Li, Parinya Punpongsanon, Joe Paradiso, and Pattie Maes. 2020. Wearable Sanitizer: Design and Implementation of an Open-source, On-body Sanitizer. In SIGGRAPH Asia 2020 Emerging Technologies (SA '20). Association for Computing Machinery, New York, NY, USA, Article 1, 1–2. DOI:https://doi.org/10.1145/3415255.3422897.SA '20: SIGGRAPH Asia 2020 [December 4 - 13, 2020